Adaptive Dimensional Gaussian Mutation of PSO-Optimized Convolutional Neural Network Hyperparameters
نویسندگان
چکیده
The configuration of the hyperparameters in convolutional neural networks (CNN) is crucial for determining their performance. However, traditional methods hyperparameter configuration, such as grid searches and random searches, are time consuming labor intensive. optimization CNN a complex problem involving multiple local optima that poses challenge particle swarm (PSO) algorithms, which prone to getting stuck achieving suboptimal results. To address above issues, we proposed an adaptive dimensional Gaussian mutation PSO (ADGMPSO) efficiently select optimal configurations. ADGMPSO algorithm utilized cat chaos initialization strategy generate initial population with more uniform distribution. It combined sine-based inertia weights asynchronous change learning factor balance global exploration exploitation capabilities. Finally, elite was improve diversity convergence accuracy at different stages evolution. performance compared five other evolutionary including PSO, BOA, WOA, SSA, GWO, on ten benchmark test functions, results demonstrated superiority terms value, mean standard deviation. then applied LeNet-5 ResNet-18 network models. MNIST CIFAR10 datasets showed achieved higher generalization ability than PSO-CNN, LDWPSO-CNN, GA-CNN.
منابع مشابه
Hyperparameters Optimization in Deep Convolutional Neural Network / Bayesian Approach with Gaussian Process Prior
Convolutional Neural Network is known as ConvNet have been extensively used in many complex machine learning tasks. However, hyperparameters optimization is one of a crucial step in developing ConvNet architectures, since the accuracy and performance are totally reliant on the hyperparameters. This multilayered architecture parameterized by a set of hyperparameters such as the number of convolu...
متن کاملA Convolutional Neural Network based on Adaptive Pooling for Classification of Noisy Images
Convolutional neural network is one of the effective methods for classifying images that performs learning using convolutional, pooling and fully-connected layers. All kinds of noise disrupt the operation of this network. Noise images reduce classification accuracy and increase convolutional neural network training time. Noise is an unwanted signal that destroys the original signal. Noise chang...
متن کاملPSO optimized Feed Forward Neural Network for offline Signature Classification
The paper is based on feed forward neural network (FFNN) optimization by particle swarm intelligence (PSI) used to provide initial weights and biases to train neural network. Once the weights and biases are found using Particle swarm optimization (PSO) with neural network used as training algorithm for specified epoch, the same are used to train the neural network for training and classificatio...
متن کاملSTLF Based on Optimized Neural Network Using PSO
The quality of short term load forecasting can improve the efficiency of planning and operation of electric utilities. Artificial Neural Networks (ANNs) are employed for nonlinear short term load forecasting owing to their powerful nonlinear mapping capabilities. At present, there is no systematic methodology for optimal design and training of an artificial neural network. One has often to reso...
متن کاملA Two-Dimensional Convolutional Neural Network for Brain Tumor Detection From MRI
Aims: Cancerous brain tumors are among the most dangerous diseases that lower the quality of life of people for many years. Their detection in the early stages paves the way for the proper treatment. The present study aimed to present a two-dimensional Convolutional Neural Network (CNN) for detecting brain tumors under Magnetic Resonance Imaging (MRI) using the deep learning method. Methods & ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied sciences
سال: 2023
ISSN: ['2076-3417']
DOI: https://doi.org/10.3390/app13074254